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Reliability  Analysis  For 
Complex,  Repairable  Systems 

Larry  H.  Crow* 

Abstract . The  reliability  of  a complex  system  that  is  repaired 
(but  not  replaced)  upon  failure  will  often  depend  on  the  system 
chronological  age.  If  only  minimal  repair  is  made  so  that  the 
intensity  (instantaneous  rate)  of  system  failure  is  not  disturbed, 
then  a nonhomogeneous  Poisson  process  may  be  used  to  model  this  age- 
dependent  reliability.  This  paper  considers  the  theoretical  and 
practical  implications  of  the  nonhomogeneous  Poisson  process  model  for 
reliability,  and  gives  estimation,  hypotheses  testing,  comparison  and 
goodness  of  fit  procedures  when  the  process  has  a Weibull  intensity 
function.  Applications  of  the  Weibull  model  in  the  field  of  reli- 
ability and  in  other  areas  are  discussed. 

1.  Introduction.  Many  systems  can  be  categorized  into  two  basic 
types;  one-time  or  nonrepairable  systems,  and  reusable  or  repairable 
systems.  The  term  "system"  is  used  in  a broad  sense  in  this  paper  and 
may,  for  example,  simply  mean  a component.  If  continuous  operation  of 
the  system  is  desired,  then  in  the  former  case  the  system  would  be 
replaced  by  a new  system  upon  failure.  An  example  would  be  the 
replacement  of  a failed  light  bulb  by  a new  bulb.  The  component  or 


*U.S.  Army  Materiel  Systems  Analysis  Activity,  Reliability,  Availability 
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system  may,  of  course,  be  part  of  a larger  system.  For  example,  the 
water  pump  of  a vehicle  may  be  considered  a one-time  or  nonrepairable 
system.  If  failure  data  are  available  for  a nonrepairable  system, 
then,  since  the  failure  times  are  independent  and  identically  distrib- 
uted, the  analyses  may  involve  the  estimation  of  the  corresponding 
life  distribution.  In  the  latter  case,  under  continuous  operation,  the 
system  is  repaired,  but  not  replaced,  after  each  failure.  For  example, 
if  the  system  is  a vehicle  and  the  water  pump  fails,  then  the  water 
pump  is  replaced  and,  hence,  the  vehicle  is  repaired. 

For  a repairable  system,  one  is  rarely  interested  primarily 
in  time  to  first  failure.  Rather,  interest  generally  centers  around 
the  probability  of  system  failure  as  a function  of  system  age.  Exact 
reliability  analyses  for  complex,  repairable  systems  are  often  diffi- 
cult because  of  the  complicated  failure  process  that  may  result  from 
the  replacement  or  repair  policy.  A common  procedure  in  practice  is 
to  approximate  the  complicated  stochastic  process  by  a simpler 
stochastic  process,  which  although  not  exact,  still  yields  useful 
practical  results.  One  such  mathematical  idealization  assumes  that  the 
failure  times  of  the  complex  repairable  system  follow  a (non)  homo- 
geneous Poisson  process. 

In  the  next  section,  this  paper  discusses  the  homogeneous  and 
nonhomogeneous  Poisson  processes  with  respect  to  the  theoretical  and 
practical  implications  of  these  models  for  the  reliability  theory  of 
complex,  repairable  systems.  In  Section  3 we  give  estimation, 
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hypothesis  testing,  comparison  and  goodness  of  fit  procedures  for  a 
nonhomogeneous  Poisson  process  with  mean  value  function  given  by  a 
Weibull  intensity  function.  In  Section  4 application  of  these  proce- 
dures in  reliability  and  other  areas  is  discussed. 

2.  The  Poisson  Processes.  In  this  section,  we  discuss  the 
theoretical  and  practical  implications  of  the  Poisson  processes  in 
terms  of  the  reliability  of  a complex,  repairable  system.  We  begin 
with  the  homogeneous  Poisson  process  and  later  generalize  to  the  process 
of  particular  concern  in  this  paper,  the  nonhomogeneous  Poisson  process. 

Let  X denote  the  intensity  of  a homogeneous  Poisson  process. 

If  At  is  infinitesimally  small,  then  XAt  is  ■’oproximately  the  probabil- 
ity of  an  event  occurring  in  any  interval  of  length  At,  regardless  of 
the  time  t at  the  beginning  of  the  inter/al.  In  terms  of  a repairable 
system,  this  implies  that  t.ne  system  is  not  improving  nor  wearing  out 
with  age,  but  rather  is  maintaining  a constant  intensity  of  failure. 

For  various  repairable  systems,  particularly  of  the  complex 
electronic  type,  a constant  intensity  of  failure  has  been  observed  to 
be  closely  representative,  after  perhaps  an  initial  burn-in  period.  The 
period  in  which  a system  exhibits  a constant  intensity  of  failure  is 
often  called  the  system  "useful  life."  If  a complex  system  consists 
of  a large  number  of  components,  each  acting  independently,  if  the 
failure  of  a component  results  in  a failure  of  the  system,  and  if  each 
component  is  replaced  upon  failure,  then  under  fairly  general  condi- 
tions, the  occurrence  of  failures  of  the  system  will  approach  a constant 
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intensity  as  component  number  and  operating  time  become  large.  (See 
Barlow  and  Proschan  [1965],  pp.  18-21.)  To  benefit  from  this  result  in 
practice  may  require  an  extensive  amount  of  system  operating  time. 

Also,  many  complex  repairable  systems,  for  example  vehicles,  generally 
experience  a wear-out  phase  which  eventually  makes  them  economically 
impractical  or  too  unreliable  to  continue  in  service  without  perhaps 
undergoing  overhaul.  Therefore,  these  systems  generally  will  never 
achieve  the  equilibrium  state  of  a homogeneous  Poisson  process. 

The  homogeneous  Poisson  process  cannot  describe  the  occurrence 
of  failures  for  many  systems  over  their  entire  life  cycle  but  may  often 
be  suitable  as  a model  over  some  portion  of  their  life.  For  studies 
involving  the  consideration  of  mission  reliability,  reliability  growth, 
maintenance  policies,  overhaul  and  trade-in  times,  etc.,  it  is  important 
that  realistic  models  be  applied. 

A generalization  of  the  homogeneous  Poisson  process  which 
allows  for  changes  or  trend  in  the  intensity  of  system  failures  is  the 
nonhomogeneous  Poisson  process  with  intensity  function  u(t).  Analogous 
to  XAt  in  the  homogeneous  Poisson  process,  u(t)At  is  approximately  the 
probability  that  an  event  will  occur  in  the  interval  (t,  t + At).  Note 
that  in  the  special  case  when  the  intensity  function  u(t)  is  constant 
for  all  t,  the  nonhomogeneous  Poisson  process  reduces  to  the  homogeneous 
Poisson  process.  Therefore,  any  results  or  considerations  related  to 
the  nonhciiiogencous  Poisson  process  are  also  valid  for  the  homogeneous 
Poisson  process. 
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Unlike  the  homogeneous  Poisson  process  failure  probability, 
the  intensity,  u(t)At,  may  depend  on  the  age  t of  the  system.  During 
debugging,  u(t)  would  be  decreasing,  u(t)  would  be  constant  over  the 
system  useful  life,  and  would  be  increasing  during  the  wear-out  phasa 
of  the  system. 

If  the  failures  of  a repairable  system  follow  a nonhomogeneous 
Poisson  process,  then  the  number  of  failures  and  the  types  of  repair 
actions  taken  during  a period  [0,t]  do  not  affect  the  probability  of 
failure  during  (t,  t + At).  In  particular,  suppose  that  the  system 
fails  at  time  t and  is  subsequently  . epaired  and  put  back  into  service. 
(Repair  time  is  assumed  to  be  negligible.)  According  to  the  model,  the 
probability  of  a system  failure  during  (t,  t ♦ At)  is  u(t)M»  and  would 
equal  this  value  even  if  the  system  had  not  failed  at  time  t.  In 
practice,  however,  if  repair  is  competent,  then  one  would  expect  a 
decrease  in  failure  probability  after  repair  from  its  value  at  the  time 
of  failure.  If  the  system  is  complex,  consisting  of  many  components, 
then  the  replacement  of  a single  component  may  not  decrease  this 
probability  significantly.  For  example,  the  replacement  of  a failed 
water  pump  in  a vehicle  would  generally  not  improve  vehicle  reliability 
greatly  immediately  after  replacement  from  what  it  was  immediately 
before  failure.  The  nonhomogeneous  Poisson  process  assumes  idealis- 
tically that  the  reliability  does  not  change  at  all. 

A basic  property  of  the  nonhomogeneous  Poisson  process  ' 1 

be  given  next. 
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Theorem  2.1.  Let  {N(t),  t 0)  be  a nonhomogeneous  Poisson 

process,  let  X-  * 0,  and  X < X < X ...  be  successive  times  f 
u 12  3 

occurrence  of  events.  Let  ■ Xj^  - X^,  i ■ 1,2,...,  be  the  times 
between  successive  events.  Then  the  cumulative  distribution  function 
(c.d.f.)  of  Yj,  given  that  the  (i-l)st  evont  occurred  at  time  X^  . , 
is 


F^y) 


F^xi-i  * y)  - p<xi-i 

r-T-(x-;5 


) 


y > 0,  i ■ 1,2,...,  where  F(x)  ■ 1 - e"U^  and  U(x)  * /u(z)dz. 

0 

Hence,  in  general,  the  times  between  successive  events  are 
not  independent  and  identically  distributed.  However,  when  u(t)  = X 
(the  homogeneous  Poisson  process) , then  these  times  are  independent  and 
identically  distributed  according  to  the  exponential  distribution  with 
mean  1/A,  since  F^(y)  ■ 1 - e~*^,  y > 0,  i * 1,2,....  Furthermore, 
observe  that  in  the  nonhomogeneous  case  the  c.d.f.  F of  the  time  to 
first  event  is  identical' y equal  to  F(y)  » 1 - e"U^.  The  failure  rate 
of  F is  defined  by  r(y)  = f (y)/[l-F(y)]  for  F(y)  < 1,  and  r(y)  * » for 
F(y)  * 1,  where  f denotes  the  density  of  F.  Hence,  the  failure  rate  for 
F is  r(y)  = u(y),  y > 0.  That  is,  the  intensity  function  u(*)  of  the 
nonhomogeneous  Poisson  process  is  equivalent  to  the  failure  rate  of  F, 
The  physical  interpretation  of  the  failure  rate  is  that  for  an  infin- 
itesimally small  Ay,  .^y)A y is  approximately  the  probability  that  the 


first  event  occurs  in  (y,y+-Ay),  given  no  event  to  time  y. 

For  the  homogeneous  Poisson  process,  F is  the  exponential 

distribution  with  constant  failure  rate.  A popular  alternative  to  the 

-Ay* 

exponential  distribution  is  the  Weibull  distribution  H(y)  * 1 - e 7 , 

8- 1 

y > 0,  A > 0,  $ > 0,  with  failure  rate  r(y)  ■ A£y  . When  6 «*  1,  the 

Weibull  reduces  to  the  exponential.  This  suggests  that  a possibly 

useful  extension  of  the  homogeneous  Poisson  process  with  exponential 

times  between  failures  is  the  nonhomogeneous  Poisson  process  with 

Weibull  time  to  first  failure.  The  intensity  function  for  this  non- 

B"  1 

homogeneous  Poisson  process  is  u(t)  * A£tp  , t > 0.  If  the  failures 
of  a repairable  system  follow  this  process,  then  for  £ > 1 (.3  < 1) , u(t) 
is  increasing  (decreasing)  and,  hence,  the  system  is  wearing  out 
(improving)  with  age.  When  £ - 1,  the  process  reduces  to  the  homo- 
geneous case  with  intensity  A. 

The  nonhomogeneous  Poisson  process  with  Weibull  intensity 
function  will  be  considered  further  in  the  remainder  of  this  paper. 

3.  The  Weibull  Intensity  Functicn.  In  practice  one  may  not  know 
various  parameters  of  a particular  model  that  is  to  be  applied.  Con- 
sequently, the  application  of  the  model  may  depend  on  which  statistical 
procedures  regarding  these  unknown  parameters  are  available. 

In  this  section  it  is  assumed  that  events  are  occurring 
according  to  a nonhomogeneous  Poisson  process  with  Weibull  intensity 
function 

(3.1)  u (t)  = A£t*'J 
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A>0,  B>0,  t>0.  Estimation,  hypotheses  testing,  comparison  and 
goodness  of  fit  procedures  are  gi\/en  when  data  consist  of  the  times 
of  the  successive  events  occurring  during  the  period  of  study.  First, 
we  need  the  following  preliminaries. 

In  reliability  terminology,  suppose  that  the  number  of 
systems  under  study  is  K and  the  q-th  system  is  observed  continuously 
from  time  S to  time  T , q = 1,...,K.  During  the  period  [S  , T ] , let 

q q ^ ^ 

Nq  be  the  number  of  failures  experienced  by  the  q-th  system  and  let 

be  the  age  of  this  system  at  the  i-th  occurrence  of  fa’  re, 

i = 1 , . . . ,N  , q = 1 , . . . , K.  The  times  S,  T , q = 1,...,K,  may  possibly 
^ M R 

be  observed  failure  times  for  the  q-th  system.  If  X..  = T , then  the 

Nq.q  q 

data  on  the  q-th  system  are  said  to  be  failure  truncated,  and  Tq  is  a 

random  variable  with  N fixed.  If  X..  < T , then  the  data  on  the 

q Nq,q  q’ 

q-th  system  are  said  to  be  time  truncated  with  Nq  a random  variable. 
Note  that  when  Sq  is  not  a failure  time  and  data  are  time  truncated, 
then  N is  a Poisson  random  variable  with  mean  U(T  ) - U(S  ) = 

q v q q 

T 

,q 

/ u(t)dt. 

S 

q 

3.1.  Maximum  Likelihood  Estimates  of  A and  (5.  Suppose  the 
q-th  system  is  observed  continuously  from  time  Sq  to  time  Tq, 
q = 1,...,K.  Then  the  maximum  likelihood  (ML)  estimates  of  A and  B are 
values  A and  B satisfying  the  equations 
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(3.2) 


A = 


K 

l N 
i c 
q=l 


1 (T 

q=l 


3 


se) 

q 


(3.3) 


e = 


K 

I N 

Ai 


* s 3 
X I CT“lo8  T 
q=l  4 M 


SPlog  S ) 

q q 


I I log  x. 

q=l  i=l  ll* 


where  0*log  0 is  taken  to  be  0.  In  general,  these  equations  cannot  be 
solved  explicitly  for  A and  3,  but  must  be  solved  by  iterative  pro- 

A.  A 

cedures.  Obtaining  A and  6,  one  may  then  estimate  the  intensity 
function  u(t)  by 

A 

(3.4)  u (t)  = Apt3-1, 

t > 0. 


When  S =0,  and  data  are  time  truncated  at  T * T, 

q ■ q 

q = 1 , . . . , K,  then  the  ML  estimates  A and  3 are  in  closed  form. 


Specifical ly , 

(3.5) 


(3.6) 


When  K = 1,  S - 0 and  data  are  failure  truncated  (i.e., 

3 T^),  then  X and  3 are  also  in  closed  fora.  The  estimates  are 

T ^ 

1 

N 

0 = ^ _ 1 . 

I T 

l logC^r-1) 

i=l  il 

Example.  Suppose  K = 3 systems  are  observed  during  [0,  T] , 

T = 200.  That  is,  the  data  are  time  truncated  with  T = 200, 

q 

q = 1,2,3.  This  experiment  was  simulated  on  a computer  with  X = 0.6 

and  6 = 0.5.  These  results  are  given  in  Table  1.  Since  the  T^'s  are 

equal,  the  ML  estimates  of  X and  3 are  calculated  from  the  closed  form 

expressions  (3.5)  and  (3.6).  From  the  simulated  data,  the  ML  estimate 

of  X is  A = 0.461,  and  the  ML  estimate  of  Ms  P = 0.615. 

If  it  is  assumed  a priori  that  systems  1,  2,  and  3 are 

observed  only  to  the  10th,  15th  and  11th  failure  respectively,  then 

the  data  are  failure  truncated.  Thus,  the  ML  estimates  of  X and  3 are 

calculated  from  expressions  (3.2)  and  (3.3)  using  iterative  procedures. 

From  the  simulated  data  T = 197.2,  T - 190.8,  T * 195.8,  and  the  ML 

1 2 3 

estimates  of  X and  3 are  X = 0.443,  3 = 0.626. 


1 » 

(3.7) 


(3.8) 
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TABLE  1 

Simulated  Data  for  K=3  Systems  Operated  for  Time 
T=  200  when  Xs  0.6  and  $ - 05 


System  1 
Xj  i 

4.3 

4.4 
10.2 
23.5 
23.8 
26.4 

74.0 

77.1 

92.1 
197.2 


N,  = 10 


=19.661 


System  2 
X j 2 

0.1 

5.6 

18.6 

19.5 
24.2 

26.7 
45.1 

45.8 

75.7 

79.7 

98.6 
120.1 

161.8 
180.6 
190.8 

N2  = 15 


= 26.434 


System  3 

Xj  3 

8.4 

32.5 
44.7 
48.4 

50.6 

73.6 
987 

112.2 

129.8 
1360 

195.8 


N3=ll 


= 12.398 


1 


a 

:j 

I 

i 


T 


58.493 


3.2.  Conditional  Maximum  Likelihood  Estimates  of  8. 
Estimates  of  8 which  are  always  in  closed  form  w’  enever  S =0, 
q = 1,...,K,  may  be  obtained  by  considering  the  conditional  ML 
estimates.  If  the  intensity  function  for  the  q-th  system  is 


(3.9) 


uq(t)  = yt*-1, 


X >0,  8 > 0,  t>0,  these  conditional  ML  estimates  are  the  same 

q 

whether  the  X^'s  are  specified  to  be  equal  or  different. 

Suppose  that  data  on  the  q-th  system  are  failure  truncated 

(i.e.,  X..  = T ) and  S = 0,  q = 1, . . . ,K.  Then,  conditioned  on  the 

Nq>q  q q 

failure  times  Tj,...,T^,  the  ML  estimate  of  8 is 


(3.10) 


I (N  -1) 

..HI1  . - 

K V1  T 
I I 108CJ-) 

1"  i A « 

1=1  lq 


If  the  data  on  the  q-th  system  are  time  truncated  and 
Sq  = 0,  q = 1,...,K,  then  is  the  random  number  of  failures  experi- 
enced by  this  system  during  [0,  T ] , q = 1,..,,K.  Conditioned  on 
N^,...,Ng,  the  ML  estimate  of  6 is 


(3.11) 


K Nq  T 

I l logc^a-) 

q=l  i=l  iq 
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(3.12) 


In  general,  let 


M = 

q 


N if  data  on  the  q-th  system 
^ are  time  truncated 

N -1  if  data  on  the  q-th  system 
^ are  failure  truncated, 


q = 1,...,K.  Then,  conditioned  on  N (time  truncated)  or  XN  (fail- 

q q>q 

ure  truncated),  q - 1,...,K,  the  ML  estimate  of  3 is 


(3.13) 


Further,  if 


K \ T„ 
l l log(-3-) 
q=l  i=l  X. 


(3.14) 


[M. 


i q 
q=l  M 


(3.15) 


M-]  - 

3 = ~ P 


is  an  unbiased  estimate  of  3. 

In  the  special  case  when  the  data  are  time  truncated  at  = 

A 

T and  S =0,  q = 1,...,K,  observe  that  the  ML  estimate  3 given  by 

q 

(3.6)  and  the  conditional  ML  estimate  3 given  by  (3.13)  are  equal. 

Example . Consider  the  simulated  data  in  Table  1.  Since  the 
data  for  each  of  the  3 systems  are  time  truncated  at  T = 200,  then 
3=3“  0.615.  The  unbiased  estimate  of  Ms  3 = (35/36)3  = 0.598. 

Suppose  that  it  is  assumed  a priori  that  systems  1,  2 and  3 
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are  observed  only  to  the  10th,  15th  and  11th  failure,  respectively. 
In  this  case  the  data  are  failure  truncated  respectively  at  197.2, 
190.8  and  195.8  for  systems  1,  2 and  3.  The  conditional  ML  estimate 
of  8 is  therefore 


8 = 


M 


3 Mn 

I 1“ 

q=l  i=l 


T 

log  Cjj3-) 

iq 


0.575, 


where  M = M + M + M , M --9,  M =14,M  =10,  T = 197.2,  T = 

12  3!  2 3 1 2 

190.8,  and  = 1L> S - 8 . The  unbiased  estimate  of  8 is  8 = (32/33)8  * 
0.557. 

3.3.  Hypotheses  Tests  and  Confidence  Bounds  on  8.  We  may 
use  the  conditional  ML  estimate  of  8,  8 given  by  (3.13)  to  test  hypoth- 
eses and  construct  conditional  confidence  bounds  on  the  true  value  of 
8.  To  do  this  we  use  the  result  that 

(3.16)  x2  = 2M8_ 

8 

is  distributed  as  a Chi-Square  random  variable  with  2M  degrees  of  free- 
dom. This  statistic  may  therefore  be  used  to  test  hypotheses  on  8. 

When  M is  moderate,  the  statistic 

(3.17)  u = vff(l-  - 1) 

6 

is  distributed  approximately  normal  with  mean  0 and  variance  1. 
Consequently,  one  may  also  use  this  statistic  to  test  hypotheses  on  8 
for  moderate  M. 
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To  construct  exact,  conditional  confidence  bounds  on  6 we  use 
the  x2  statistic  given  by  (3.16),  The  exact  (]-ct)*100  percent  lower 
and  upper  confidence  bounds  are 


(3.18) 


~X2(|,2M) 
eib  = P 2M 


(3.19) 


~ X2  (1  - y,2M) 
$ub  = 3 2M 


respectively,  where  x2(j,2M)  [x2(l  - y.2M)]  is  the  j -th  [(1  - j)-th] 
percentile  for  the  Chi-Square  distribution  with  2M  degrees  of  freedom. 

When  M is  moderate  however,  the  statistic  w,  which  is  approx- 
imately normal,  may  be  used  to  construct  approximate  confidence  bounds. 
This  approximation  yields  (l-a)*100  percent  lower  and  upper  confidence 
bounds 

P 


(3.20) 


glb  = ^ 


/It 


: : | 
; ■; 
,•  i 


(3.21) 


Pub  = W + 


M 


respectively,  where  is  the  ir-th  percentile  for  the  normal  distribution 
with  mean  0 and  variance  1 , tt  = 1 - a/2 

Example.  Consider  again  the  simulated  results  presented  in 
Table  1.  The  conditional  ML  estimate  of  8 was  computed  to  be  8 = 0.615, 
with  M = 36.  Using  the  normal  approximation,  90  percent  conditional 
confidence  bounds  on  8 are 
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3.4.  Hypotheses  Tests  and  Confidence  Bounds  on  X £3  known) . 
Suppose  that  observations  begin  at  time  0 on  each  of  the  K systems 
under  study.  That  is,  * 0,  q » 1,.,.,K.  Under  time  truncated  test- 
ing on  these  K systems,  the  random  total  number  of  failures  N = 

K B 

N,  + •••  + N„  has  the  Poisson  distribution  with  mean  6 a X ) T , where 
In  , □ 

q*l  ^ 

T is  the  truncation  time  for  the  q-th  system  q * 1,...,K.  Also,  under 

3 v 

K 3 

, N . 
q=l  q' 


failure  truncated  testing  on  the  K systems,  the  statistic  V = 2X  £ 

q=  L q,Cl 


has  the  Chi-Square  distribution  with  2(N^  ♦ •••  + NK)  degrees  of  free- 
dom, where  X.,  is  the  age  of  the  q-th  system  at  the  N -th  failure, 
Nq»q  q 

q = 1,...,K. 

The  statistics  N and  V may  be  used  in  the  usual  manner  to 
test  hypotheses  and  construct  confidence  bounds  on  X when  3 is  known. 
For  time  truncated  testing,  the  (l-y)*100  percent  lower  and  upper  con- 
fidence bounds  on  X are 


(3.22) 


XlbW  * 


X2(|-,2N) 

rr 

2 I t® 

q=l  H 


(3.23) 


Xub^  " 


X2(l  - ^-,2N+2) 


3 


), 


2 l T 
q=l  « 
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respectively.  For  failure  truncated  testing,  the  (l-y)*100  percent 
lower  and  upper  confidence  bounds  on  X are 


(3.24) 


Alb<« 


X2(|-,2N) 
K ~ 

2 I Xw 

Q=1  V 


(3.25) 


Xub^ 


X2(l  - J-.2N) 

V 

e 


2 vs . 

q=l  q 


respectively. 


Example . Consider  again  the  simulated  data  in  Table  1. 

These  data  on  K * 3 systems  are  time  truncated  at  T * T = T * 200. 

l 2 3 

For  N = 36,  y = 0.05,  we  obtain  X2(j,2N)  = 50.2,  x2U  - £,2N+2)  - 99.6. 
Consequently,  from  (3.22)  and  (3.23),  95  percent  lower  and  upper  con- 
fidence bounds  on  X are 


■ f^*0'592' 


xub^  111  ‘ 

2KT 


where  0 = 0.5. 

3.5.  Simultaneous  Confidence  Bounds  on  X and  8.  Recall  from 
(3.18)  and  (3.19)  that  and  8ufa  denote  respectively  the  (l-a)’lOO 
percent  lower  and  upper  conditional  confidence  bounds  on  8.  Also, 
recall  from  (3.22)  and  (3.23)  [(3.24)  and  (3.25)]  that  X^(P)  and 
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Xub(6)  denote  respectively  the  (1-y) *100  percent  lower  end  upper 
confidence  bounds  on  X when  data  are  time  truncated  [failure  truncated] 
on  the  K systems  and  $ is  known. 

Suppose  that  data  on  the  K systems  are  time  truncated.  Then 
(1-a) (1-y) *100  percent  conservative*  simultaneous  confidence  bounds  on 
X and  8 may  be  constructed  in  the  following  way.  Given  (1-a) *100 
percent  conditional  confidence  bounds,  0^*  0^,  on  let 


(3.26) 


Xlb(*W 


X2(£,2N) 

“Sc  C 


(3.27) 


X . (0.,  ) 
ub  lb' 


X2(l  - £,2N+2) 
K pT 

2 l T„  lb 


using  (3.22)  and  (3.23).  Then  (1-a) (1-y) *100  percent  conservative 
simultaneous  confidence  bounds  on  X and  6 are  ^ib(Pub)»  *ub^lb^* 
Pjb>  when  data  on  the  K systems  are  time  truncated. 

When  data  on  the  K systems  are  failure  truncated,  then 
similar  bounds  are  constructed  using  (3.24)  and  (3.25)  to  compute 

xlb(8ub)  an,i  WV' 


*That  is,  our  assurance  is  at_  least , instead  of  exactly  equal  to,  a 
specified  value  that  the  parameters  will  lie  within  the  stated  bounds. 
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Example,  From  the  data  in  Table  1 and  (3.18)  - (3.19),  we 
calculate  that  exact  90  percent  conditional  confidence  bounds  on  8 are 
* 0.459  and  Bub  ■ 0.793,  These  data  on  the  K ■ 3 systems  are  time 
truncated  at  T ■ T * T * 200,  with  N » 36  failures.  For  y ~ 0.10, 

1 2 3 ft 

we  have  X2(j»2N)  = 53.5,  x2(l  - J.2N+2)  » 95.1.  Also,  (200)  lb  » 11.4 
6 . 

(2G0)  u « 66.8.  Therefore,  from  (3.26)  and  (3.27), 


(P..J  « 


53.5 


lb v ub'  2*3* (66.8) 


0.133, 


x rfi  x - 95 . 1 

ub'xlr  “ 2-3- (11.4) 


1.39. 


Hence,  (.90) (.90) *100  (=  81)  percent  conservative  simultaneous  con- 
fidence bounds  on  A and  8 are  (0.133,  1.39;  0.459,  0.793). 

3.6.  Comparisons  for  8^.  Suppose  that  K 2 systems  are 
under  study  and  the  intensity  function  for  the  q-th  system  is 

e -i 


(3.28) 


u (t)  = A 8 t 
q q q 


A > 0,  8 > 0,  t > 0,  q * 1, . . . ,K.  Regarding  the  A 's  as  nuisance 

q q q 

parameters,  one  may  wish  to  compare  the  intensity  functions  u^(*). 
q = 1,...,K,  by  comparing  the  B^'s.  Procedures  for  testing  the 
hypothesis 

(3.29)  Hq:  p = •••  = 8, 

will  be  considered  next. 


Let  8 denote  the  conditional  ML  estimate  of  8 given  by 

q q 
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(3.13)  calculated  front  data  on  the  q-th  system,  q ■ 1,..., 


K.  Then 


from  (3.16), 
(3.30) 


X2  * 


2M_S 


SL2. 


(q  * 1,...,K)  are  conditionally  distributed  as  independent  Chi-Square 
random  variable'  with  respective  degrees  of  freedom  2M^,  where  is 
defined  by  (3.12). 


(3.31) 


When  K = 2,  we  may  test  Hq  using  the  statistic 

XV2M 

F * -i K 

X2/2M 
2 2 


If  Hq  is  true,  then  F equals  and  has,  conditionally,  the  F distri 

bution  with  (2M^ , 2M^)  degrees  of  freedom.  Consequently,  one  may 
calculate  this  statistic  and  refer  to  tables  for  the  F distribution  to 
determine  the  appropriate  critical  points  to  test  when  K * 2. 

For  K > 2,  to  test  the  hypothesis  3 * * 3,.,  the  likeli- 

hood  ratio  procedure  (see  Lindgren  [1962],  p.  253)  yields  the  statistic 

K 

(3.32)  L * l M log(B  ) - Mlog(8*)  , 

q=l  ^ 4 

K , K - 

where  M * T M and  (6*)’  * [ H f ’‘/M.  Let 

q.l  1 ,.l  <1  <1 
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Then,  if  Ho  is  true,  the  statistic 
(3.33)  D ■ 

is  approximately  distributed  as  a Chi-Square  random  variable  with 

(K  - 1)  degrees  of  freedom,  using  (3.30)  and  the  results  of  Bartlett 

(1937) . One  may  therefore  calculate  the  statistic  D to  test  Hq  when 

K > 2,  and  refer  to  the  Chi-Square  tables  with  (K  - 1)  degrees  of 

freedom  to  determine  the  appropriate  critical  points. 

Example.  For  the  simulated  data  in  Table  1 suppose  that  the 

3-1 

intensity  function  for  the  q-th  system  is  u (t)  * U t ^ , q * 1,2,3, 

9 9 9 

and  we  wish  to  test  the  hypothesis  that  3 = 3 . From  the  data  on 

1 

these  systems  we  calculate  that  3 « 0.509  and  3 * 0.567.  Therefore, 

1 2 

F * (3  / 3 ) = 1.11.  The  95-th  percentile  for  the  F distribution  with 
2 1 

(20,  30)  degrees  of  freedom  is  1,93.  Since  1,11  < 1.93,  we  accept  the 

hypothesis  that  3^  55  3^  at  the  5 percent  significance  level. 

Suppose  instead  that  we  had  wished  to  test  the  hypothesis 

that  3 =3=3,  The  appropriate  statistic  is  D given  by  (3.33), 

12  3 

From  the  data  we  find  that  D = 1,84.  From  the  Chi -.Square  tables  with 
K - 1 = 2 degrees  of  freedom,  we  find  that  the  2.5  and  97.5  per- 
centiles are  respectively  0,0506  anJ  7.38.  Since  0.0506  < D < 7.38, 
we  accept  the  hypothesis  3^  = 3^  * 3^  at  the  5 percent  significance 
level . 

3.7.  Goodness  of  Fit  Test.  In  practice  we  may  not  be  willing 
to  assume  that  the  failure  times  of  the  repairable  systems  under  study 
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follow  a nonhomogeneous  Poisson  process  with  Weibull  intensity 
function,  but  want  to  test  this  hypothesis  by  statistical  means.  One 
possible  method  (see  Parzen  [1962],  p.  143)  is  to  use  the  CrameT  Von 
Mises  goodness  of  fit  statistic. 

To  illustrate  the  application  of  this  statistic,  suppose  that 
K like  systems  are  under  study  and  we  wish  to  test  the  hypothesis 
that  their  failure  times  follow  a nonhomogeneous  Poisson  process  with 
intensity  function 

(3.34)  u (t)  = Xete_1, 
t > 0,  A > 0,  and 

(3.35)  & = e0, 

> 0,  a fixed  value.  Assume  also  that  the  q-th  syste  i is  observed 

during  the  period  [0,  T ] , q = 1,...,K.  From  (3.12)  we  have  that  if 

M 

X.,  = T (failure  truncation),  then  M = N - 1,  and  if  Xx,  < T 

Nq,q  q v q q Nq,q  q 

(time  truncation),  then  M = N , q = 1, . . . ,K.  Also,  from  (3.1),  recall 
K q q 

that  M = I M . 

q i q 


To  compute  the  Crar,ier-Von  Mises  statistic  W^,  we  need  only 


consider  the  M transformed  failure  times 
(3.36) 


X. 

X*  = — iH. 

iq  T ’ 

q 


i = 1,...,M  , q = 1,...,K.  Treat  all  the  M X£q’s  as  one  group  and 
order  them  from  smallest  to  largest.  Call  these  ordered  values 


i i 
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Z. ,Z~, . . . ,ZU.  That  is,  Z,  is  the  smallest  X$  , Z_  is  the  next 
i c M i lq  c 

smallest  X*  , . . . ,ZU  is  the  largest  XJ  , i ■ 1,,..,M  , q ■ 1,...,K. 
iq  M iq  H 

The  Cramer-Von  Mises  statistic  W2  is  given  by 


(3.37) 


The  asymptotic  significance  points  of  when  the  hypothesis 
H is  true  may  be  found  in  Anderson  and  Darling  (1952)  and  used  when  M 
is  only  moderately  large. 

Observe,  in  particular,  that  to  test  the  hypothesis  that  the 
failure  times  of  the  K systems  follow  a homogeneous  Poisson  process  is 
equivalent  to  testing  for  BQ  = 1. 

Generally,  we  will  not  have  a fixed  value  of  B in  mind  for 
the  hypothesis  , That  is,  we  will  usually  only  want  to  test  the 
hypothesis  H^that  the  failure  times  follow  a nonhomogeneous  Poisson 
process  with  intensity  function  (3.34),  B unspecified.  If  this  hypoth- 
esis is  accepted,  then  A and  B may  be  estimated  from  the  data. 

A reasonable  approach  to  test  is  to  use  the  statistic 
in  (3.37),  but  to  replace  Bq  by  an  estimate  of  B derived  from  the  data. 
In  general  (see  Darling  [1955]),  this  modified  Wj*  statistic  will  not 
have  the  same  distribution,  even  asymptotically,  as  the  statistic. 
However,  Darling  (1955)  showed  that  when  the  proper  estimate  of  B is 
used,  then  the  modified  statistic  is  parameter-free  (independent 
of  the  true  value  of  B)  for  any  sample  size  M.  Moreover,  the 


distribution  of  C*  converges  asymptotically  to  a distribution  with  mean 
0.09259  and  variance  0.00435  as  M •+•  « when  the  hypothesis  is  true. 

The  proper  estimate  of  6 to  use  in  calculating  is  5,  the 
unbiased  estimate  given  by  (3.15).  That  is. 


(3.38) 


where 

a _ M-l 

* Mq  T ' 
l I log(j^“ ) 
q=l  i=l  iq 

Critical  values  of  the  statistic  for  M = 2 thru  60  have 
been  determined  at  the  U.  S.  Army  Materiel  Systems  Analysis  Activity  from 
Monte  Carlo  simulation,  using  15,000  samples  for  each  value  of  M. 

Various  critical  values  of  C^  are  given  in  Table  2,  rounded  to  the 
nearest  integer.  All  values  in  the  tables  are,  of  course,  subject  to 
sampling  error. 

If  the  statistic  C^  is  greater  than  the  selected  critical 
value,  then  the  hypothesis  that  the  failure  times  for  the  K systems 
follow  a nonhomogeneous  Poisson  process  with  Weibull  intensity  function, 
is  rejected  at  the  designated  significance  level.  If  C^  is  less  than 
this  value,  then  the  hypothesis  is  accepted. 

Example . Consider  again  the  data  in  Table  1 for  K = 3 systems 

tested  for  time  T = T = T = 200.  The  unbiased  estimate  of  8 is 
1 2 3 


28 


( i 

V. 

I : 


computed  to  be  B = 0.598.  We  next  order  the  M transformed  failure 

times  (X.  /200) , i = 1,...,M  , q = 1,2,3,  where  M = 10,  M * 15, 

1£l  M 12 

M a 11,  M * 36.  This  gives  Z = 0.1/200,  Z = 4.3/200,  Z = 4.4/200, 

3 12  3 

Z = 5.6/200, ... ,Z  = 195.8/200,  Z = 197.2/200.  Using  these  order- 

4 35  36 

transformed  failure  times  and  8,  we  calculate  from  (3.38),  C2  ■ 0.  o9. 

36 

For  a hypothesis  test  at  the  0.05  significance  level,  we  find 

in  Table  2 that  the  corresponding  critical  value  for  M * 36  is  0.213. 

Since  0.069  is  less  than  0.213,  we  accept  the  hypothesis  H at  this 

2 

significance  level. 

4.  Applications.  In  this  section  we  will  discuss  some  possible 
applications  of  the  Weibull  model  to  reliability,  the  study  of  indus- 
trial accidents  and  medicine.  Observe  that  the  Weibull  intensity 
function  u(t)  = XBt^-1  is  strictly  monotonic  for  B 4 and,  of  course, 
constant  for  8=1.  Therefore,  any  applications  of  the  Weibull 
intensity  function  should  be  made  only  over  regions  of  t where,  it  is 
felt,  the  intensity  function  of  the  nonhomogeneous  Poisson  process  is 
monotone . 

4.1.  Reliability  Growth.  In  1962  J.  T.  Duane  of  General 
Electric  Company’s  Motor  and  Generator  Department  (see  Duane  [1964]) 
published  a report  in  which  he  presents  his  observations  on  failure 


data  for  five  divergent  types  of  systems  during  their  development  pro- 
grams at  G.E.  These  systems  included  complex  hydromechanical  devices, 
complex  types  of  aircraft  generators  and  an  aircraft  jet  engine.  The 


study  of  the  failure  data  was  conducted  in  an  effort  to  determine  if 


any  systematic  changes  in  reliability  occurred  during  the  development 
programs  for  these  systems.  His  analysis  revealed  that  for  these 
systems,  the  observed  cumulative  failure  rate  versus  cumulative  oper- 
ating hours  fell  close  to  a straight  line  when  plotted  on  log-log 
paper.  Similar  plots  have  been  noted  in  industry  for  other  types  of 
systems,  and  by  the  U.  S.  Army  for  various  military  weapon  systems 
during  development. 

Suppose  that  the  development  program  (or  test  phase)  for  a 
system  is  conducted  in  a "find  and  fix"  manner.  That  is,  the  system 
is  tested  until  a failure  occurs.  Design  and/or  engineering  modifi- 
cations are  then  made  as  attempts  to  eliminate  the  failure  mode(s)  and 
the  system  is  tested  again.  This  process  is  continued  for  a fixed  time 
period  or  until  the  desired  reliability  is  attained.  If  the  cumulative 
failure  rate  (expected  number  of  failures  at  time  t divided  by  t)  versus 
test  time  is  linear  on  log-log  scale,  then  the  system  failure  times 
follow  a nonhomogeneous  Poisson  process  with  Weibull  intensity  function 

O 1 

u(t)  = ABt  . If  the  system  reliability  is  improving,  then  u(t)  is 
decreasing;  i.e.,  0 < 6 < 1. 

g _ j 

At  time  t the  Weibull  intensity  function  is  u(tQ)  = A3tQ 
If  no  further  system  improvements  are  made  after  time  t , then  it  is 
reasonable  to  assume  that  the  intensity  function  would  remain  constant 
at  the  value  u(tQ)  if  testing  were  continued.  In  particular,  if  the 
system  were  put  into  production  with  the  configuration  fixed  as  it 
was  at  time  t , then  the  life  distribution  of  the  systems  produced 


would  be  exponential  with  mean 

1 1-“ 

C4.1)  »(t0)  * [u(t0)]->  - -Afy- 

From  (4.1)  the  mean  p(t)  increases  as  the  development  test- 

1-0 

ing  time  t increases  (since  8 < 1) , and  is  proportional  to  t 
Hence,  8 is  a growth  parameter  reflecting  the  rate  at  which  reli- 
ability, or  p(t),  increases  with  development  testing  time. 

4.2.  Mission  Reliability.  The  probability  R(t)  that  a 

system  of  age  t will  successfully  complete  a mission  of  fixed  duration 

d > 0 is  called  "mission  reliability."  If  the  system  is  repairable  and 

mission  aborting  failures  follow  a nonhomogeneous  Poisson  process  with 

Weibull  intensity  function,  then 

R(t)  = Prob [system  of  age  t will  not  fail  in  (t,t+d)] 

_ -[X(t+d)$-A(t)e] 

— C • 

Note  that  if  8 > 1 (wear-out),  then  R(t)  is  decreasing  with  age.  If 
8 < 1 (improvement),  then  R(t)  is  increasing  with  age.  When  8=1 
(constant  intensity  of  failures),  then  R(t)  = e a constant. 

4.3.  Maintenance  Policies.  Barlow  and  Hunter  (1960)  consid- 
ered optimum  replacement  or  overhaul  policies  for  a system  whose  fail- 
ure times  follow  a nonhomogeneous  Poisson  process.  The  optimum  re- 
placement or  overhaul  times  for  the  system  were  derived  so  as  to  maxi- 
mize the  expected  fractional  amount  of  system  uptime  over  an  infinite 
period  of  time.  Furthermore,  one  can  also  use  the  same  approach  to 
determine  optimum  replacement  or  overhaul  times  which  will  minimize  the 
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expected  maintenance  cost  over  an  infinite  time  span.  When  the  system 
has  a Weibull  intensity  function,  with  B > 1,  the  time  which  minimizes 
expected  maintenance  cost  is  given  in  Barlow  and  Proschan  (1965) , 
page  98. 

4.4.  Industrial  Accidents.  The  control  of  industrial 
accidents  generally  requires,  from  time  to  time,  new  safety  equipment, 
safety  regulations,  improved  machinery,  etc.  Hence,  one  may  expect 
that  the  occurrence  of  accidents  would  tend  to  decrease  with  time. 
Because  of  serious  injuries  or,  perhaps,  deaths  that  may  occur  as  a 
result  of  an  industrial  accident,  it  is  usually  important  to  know 
whether  or  not  the  safety  actions  are  resulting  in  a significant 
decrease  of  accidents.  The  nonhomogeneous  Poisson  process  with  Weibull 
intensity  function  may  possibly  be  useful  in  measuring  this  decrease, 
as  demonstrated  by  the  following  example. 

The  data  in  Table  1 of  Maguire,  Pearson  and  Wynn  (1952) 
represents  days  between  explosions  in  mines  in  Great  Britain  involving 


more  than  10  men  killed.  The  data  covers  the  period  from  December  6, 
1875  to  May  29,  1951.  As  noted  by  Barnard  (1953)  and  also  by  Maguire, 
Pearson  and  Wynn  (1953) , there  is  convincing  statistical  evidence  that 
the  data  in  this  table  are  not  consistent  with  the  hypothesis  of  a 
homogeneous  Poisson  process.  That  is,  the  occurrence  of  these  mine 
accidents  departs  statistically  from  a constant  intensity.  Barnard 
suggested  that  the  mine  accidents  may  follow  a nonhomogeneous  Poisson 
process  with  decreasing  intensity  function.  The  following  analysis  was 
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conducted  on  these  accident  data  using  the  Weibull  intensity  model. 

Regarding  December  6,  1875  as  time  0,  the  occurrence  times 
of  the  109  successive  mine  accidents  were  measured  from  this  date  in 
days,  with  the  last  accident  occurring  on  May  29,  1951,  or  at  T * 

26,263  days.  The  data,  therefore,  were  failure  truncated.  Secondly, 

A A 

the  ML  estimates  of  X and  8 were  computed,  giving  X ■ 0.7626,  8 * 

0.7139.  Since  the  data  were  failure  truncated,  with  N * 109,  we  have 
M = N - 1 = 108.  From  (3.8)  and  (3.10)  8*^8=  0.7074,  and  the 

unbiased  estimate  of  8 is,  from  (3.15),  8 = 8 = 0.7008. 

Using  8,  the  goodness  of  fit  statistic  C2  was  calculated, 

giving  C2  = 0.1817.  If  we  assume  that  the  5 percent  critical  value 
108 

for  M * 108  is  reasonably  close  to  the  5 percent  critical  value  0.219 

for  M = 60,  then  C2  is  not  significant  at  this  level.  That  is,  we 
108 

accept  at  the  5 percent  level  that  the  mine  accidents  follow  a non- 
homogeneous  Poisson  process  with  Weibull  intensity  function. 

~ 1 64 

A 95  percent  upper  confidence  bound  on  8 is  8 ,=  8(1  + — 1 — ■) 

UD  /To? 

= 0.8190  and  the  ML  estimate  of  the  intensity  of  mine  accidents  is 
u(t)  = XBt^'1,  t > 0, 

4.5.  Medical.  Various  illnesses  in  humans  are  of  a recurring 
nature.  For  example,  in  underdeveloped  countries  certain  gastrointes- 
tinal ailments  are  generally  prevalent  in  infants  from  shortly  after 
birth  to  about  age  one  year.  Empirical  studies  indicate  that  many 
environmental  type  ailments  in  infants  usually  have  an  increasing  rate 
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of  occurrence  over  a certain  period  of  time  after  birth.  The  rate  then 
begins  to  decrease  as  the  infant  develops  immunities  to  combat  the 
environmental  conditions. 

The  Johns  Hopkins  University's  Department  of  International 
Health,  assisted  by  the  U.  S.  Army  Materiel  Systems  Analysis  Activity,  is 
currently  conducting  studies  on  medical  data  to  determine  the  adequacy 
of  the  nonhomogeneous  Poisson  process  for  representing  the  occurrence 
of  various  gastrointestinal  ailments  in  humans.  The  ailments  selected 
are  those  of  relatively  short  duration  since  the  nonhomogeneous  Poisson 
process  assumes  an  instantaneous  time  of  occurrence.  If  the  Weibull 
model  is  found  to  provide  an  adequate  fit  for  an  ailment,  then  the 
effects  of  different  treatments  would  include  comparisons  of  the 
respective  Weibull  intensity  functions. 
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